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ABSTRACT 


Consideration  of  the  usefulness  of  edge  information  for  use 
in  segmentation  or  other  intermediate-level  picture  oper¬ 
ations  has  motivated  a  comparison  of  the  accuracy  and  reli¬ 
ability  of  a  number  of  directional  edge  operators.  The 
Hue eke 1  operator  is  singled  out  for  comment,  and  an  error  in 
its  derivation  is  noted.  Another  regional  edge  operator  is 
introduced  as  being  better  suited  to  application  on  discrete 
pictures . 
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1  .  In  t  roou c  t  i  on 


1.1.  t  a  c  kg  rou  nd 

In  any  system  f  ffr  interpreting  picture  information,  a  stock 
of  low-lev  l  operators  is  needed.  One  essential  component  of 
SJCh  a  greu-  is  a  expendable  edge-extraction  procedure  or  set  of 
procedures.  As  a  result,  a  great  many  such  algorithms,  each  with 
its  .articular  merits,  have  been  devised.  In  the  past  few  years, 
sohie  attempts  have  oeen  made  to  systematize  this  array,  with 
surveys  oy  Davis  (Fef  1),  Fram  and  Deutsch  (Ref  2),  Pratt 
(*ef  .1),  ana  by  F  rei  and  Chen  (Ref  4)  viewing  the  field  from 
so* e-hat  different  points  of  view,  and  suggesting  rather 
different  rankings  of  the  edg e -d e te c t i on  algorithms  they 
examined.  ••aryUna's  Computer  Vision  Laboratory  is  particularly 
interested  in  developing  intermediate-level  procedures  (e.g. 
relaxation,  edge-juiced  segmentation)  which  require  primitive 
edje  information  for  their  successful  application.  In  this 
context,  the  visual  fidelity  of  an  e dge -de t ec t i on  operation  is  of 
secondary  interest,  as  only  at  a  later  stage  will  final  images  be 
formed.  Th  most  commonly  used  class  of  edge-detectors  are  local 
or  regional  operators  (but  see  Ref  5 >  which  produce,  at  some  set 
of  picture  locations  an  'edge  response'  which  may  include  any  or 
all  of  the  f  cl  lo-i  ng  : 

a)  magnitude  of  the  edge  (either  height  or  slope) 

b)  direction  of  the  edge 

c)  reliability  of  the  edge  description 

a )  width,  or  o  l  u  r  . 

As  i nf  :rm  a  t ion  about  an  image  to  be  used  by  some  other 
process,  all  ot  these  measures  can  be  useful.  A  number  of 
procedures  which  produce  measures  of  the  first  three  quantities 
have  oeen  descriced.  The  present  study  has  limited  itself  to 
such  operators.  Those  included  were: 
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a)  Hue  eke l *8  edge-detection  algorithm  (Ref  6) 

b)  The  Sobel  operator,  with  least-square  goodness  of  fit 

(Ref  7) 

c)  Mero  and  Vassy's  approximate  Hueckel  operator  (Ref  8) 
a)  Hun siel's  optimal  local  template  (Ref  9) 

e)  A  new  discrete  Hueckel-like  operator  (Section  3) 

Comparison  of  the  operators,  never  an  easy  process,  was 
complicated  further  by  the  fact  that  b) ,  c),  and  d)  (as 

Implemented,  at  least)  are  purely  local  operators,  evaluated 
separately  at  each  Image  point,  while  a)  and  e)  are  Intended  to 
be  evaluated  only  on  overlapping  regions.  The  two  kinds  of 
operators  are  sufficiently  different  that  direct  comparisons  are 
very  hard  to  make.  The  approach  taken  was  to  measure  the 

degradation  in  the  edge  response  when  various  sorts  of  distortion 
were  applied  to  the  Image,  These  se  If -compa  r  1  sons  ,  then,  act  as 
measures  of  stability  and  d  iscrlmlnatory  power  that  allow 
comparison  between  the  different  techniques, 

1,2,  Characterizing  an  ideal  edge 

Cage  detection  procedures  may  be  divided  into  two  sorts: 
local  and  regional.  The  former,  typically  applied  on  very  small 
(3x3  or  4x4)  picture  windows,  can  usually  be  interpreted  as 

differentia  l  operators  of  some  sort,  used  to  define  the 

'eagintss'  at  each  point  of  the  Image,  Regional  operators,  on 
the  other  hand,  way  be  applied  on  windows  several  times  the  width 
of  the  edges  to  be  detected,  and  are  expected  to  give  responses 
when  the  entire  region  is  well  described  by  two  constant  levels 
separated  by  an  edge  of  some  specific  sort.  For  both,  the 
question  'what  is  an  edge'  must  be  asked,  but  for  regional 
operators,  the  answers  are  less  clear. 

Directional  local  operators,  though  plentiful,  all  appear  to 
measure  somethin*  like  the  gradient  at  a  point,  the  differences 
being  predominantly  due  to  different  ways  of  responding 
adequately  to  Imperfections  such  as  blurriness  «nd  noise,  or  to 
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considerations  of  computational  speed*  Regional  operators  have 
not  been  so  widely  discussed,  Hueckel's  operator  being  the  only 
widely  quoted  one  of  this  type*  (Mero  and  Vassy  described  a 
local  operator,  ana  a  regional  extension  of  it.  It  is  the  local 
version  that  we  use  in  these  comparisons*)  For  such  operators, 
three  properties  of  edges  are  of  concern  which  are  not  of  great 
importance  for  local  detection.  First,  how  broad  should  an 
'ideal'  edge  be,  and  should  the  width  be  variable.  Second, 
should  a  perfect  edge  be  necessarily  straight,  or  should  some 
class  of  curves  pe  allowed.  Finally,  if  several  edges  appear 
within  the  region,  should  the  response  give  a  total  value,  a 
maximum  value,  or  no  strong  edge  value  at  all?  Sections  2 .2  and 
3,  in  cescriLinj  operators  a)  and  e),  introduce  two  different 
rtsncnses  to  these  questions. 

1.3.  evaluation  criteria 

The  ed^e  detectors  described  were  all  evaluated  on  the  same 
set  of  images,  and  a  common  measure  of  adequacy  employed.  The 
images  include  a  set  of  synthetic  'perfect  polygonal'  images, 
which  have  Ion.,  straight  edges  inclined  at  five  degree  increments 
from  vertical  or  horizontal.  A  'real'  image  (a  oicture  of  a 
girl's  face)  was  included  as  well,  to  give  some  idea  of  response 
to  textured  edaes  of  various  curvatures.  The  evaluations  are 
descritea  in  Section  4.  Brief  descriptions  of  the  first  four 
detectors  comprise  Section  2.  In  the  course  of  this  study  some 
errors  in  the  derivation  of  Hueckel's  operator  were  found 
(describee  in  A^penaix  A),  suggesting  that  an  edge  deteetdr  with 
the  same  qualitative  behavior  be  devised  which  did  not  share  the 
technical  defects  of  Hueckel's.  Such  an  operator  is  described  in 
Section  3,  and  an  explicit  algorithm  constitutes  Appendix  B. 
Finally,  an  attempt  is  made  to  tie  together  the  results  of  the 
study,  by  making  some  estimates  of  the  usefulness  of  the 
operators  described  as  inputs  for  further  picture  interpretation. 
An  attempt  is  maoe  to  describe  the  features  of  each  operator 
which  are  important,  so  that  the  results  may  be  carried  over  to 
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definition  of  the  edge  operators 


2.1.  Local  operators 

2.1.1.  Genera  l  aescription 

A  it  hou ;h  some  variation  exists  in  the  form  of  the  local  edge 
operators  use  o  in  practice,  the  three  chosen  here  are 

representative  of  a  common  class.  For  each  of  them,  an 

or i ent  at ion-se  ns  it ive  mask  is  defined,  which  achieves  its  maximum 
resoonse  at  a  horizontal  edge.  A  second  mask  is  defined  to  be  a 
9j  oe.ree  rotation  of  the  first.  Commonly,  only  these  two  masks 
are  applied;  however,  Hummel's  operator  includes  two  aoditional 
masks,  a b a i n  9u  uegree  rotations  of  one  another.  From  the  result 
of  convolving  each  of  these  masks  with  the  given  region, 
(denoting  the  first  two  results  by  'horiz'  and  'vert')  a  response 
ano  a  uirection  are  found  as: 

resoonse  --  sqrt(vert**2  ♦  horiz**2) 
angle  —  a  re  t  an  (  ve  r  t  /  ho  r  i  z  ) 

In  actual  application,  it  is  common  to  avoid  taking  the 
square  root  by  using  some  other  combination  of  the  two  responses. 
The  angle  is  usually  obtained  as  the  arctangent,  although 
sometimes  an  alternative  —  forming  more  rotated  masks,  and 
selecting  the  maximum  response  and  associated  angle  —  is  useo 
insteau.  Finally,  if  more  than  two  coefficents  are  calculated 
(oS  by  Hummel)  a  somewhat  more  involved  calculation  is  required 

to  extract  the  response. 

All  of  the  local  operators  applied  here  are  of  the  general 
form  described,  differing  only  in  the  masks  used.  For 

consistency  ,  reliabi  lity  of  the  edge  is  obtained  in  the  same 

(stow)  way  for  every  case:  by  obtaining  the  mean  squared  error 
from  the  estimated  edge  explicitly. 
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3.1.2.  The  Socei  operator 

The  first  operator  is  explicitly  derived  as  an  approximate 
directional  derivative.  The  horizontal  mask  employed  is: 

1  2  1 
0  0  0 

-1  -2  -1 

The  double  weighting  of  the  center  points  is  motivated  by 
low-cr^er  cancellation  of  derivatives.  The  operator  is  applied 
on  a  3 n  x  3n  winuow  (usually  3x3  or  6x6)»  with  each  weight 
applieo  to  the  appropriate  nxn  average  value.  The  magnitude  of 
the  response  is  obtained  by  taking  s  square  rooty  as  indicated 

oO  O  V  e  . 

1.1.3.  The  Mero-Vassy  operator 

An  operator  intoduced  by  Mero  and  Vassy  (Ref  8)  is  the 
simrlest  on  <.  possible*  employing  as  a  horizontal  mask: 

1  1 
-1  -1 

That  is,  tne  first  n/2  rows  of  the  mask  are  +1,  the  last  n/2  rows 
are  -1  (for  odu  oiameter  n,  the  central  row  is  set  to  zero.)  For 
this  operator,  the  response  is  measured  as  the  sum  of  the 
absolute  values  of  the  vertical  and  horizontal  responses.  (Not 
only  is  this  consistent  with  the  'minimum  cost'  philosophy  behind 
this  operator,  out  it  is  in  this  case  more  accurate  than  use  of 
the  square  root  form.)  Clearly  this  mask  is  motivated  by  a  simple 
mooel  of  an  edge  as  a  step  discontinuity. 

1.1. *♦.  Hummel's  operator 

One  car  look  at  edge  operators  of  this  sort  as  attempts  to 
describe  tnr  ima^e  by  expansion  in  a  basis  set  in  which  the  terms 
included  h  -ve  high  overlap  with  an  ideal  edge  (an  idea  due  to 
Hueckel,  as  noteu  below).  Hummel  (Ref  9)  has  extended  this  idea 
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to  give  maximum  overlap  for  arbitrary  a  priori  estimates  of  eage 
airection,  For  uniform  edge  orientation  his  bases  are  of  the 
sort  already  described,  both  when  only  two  basis  functions  are 
retained  (as  in  the  previous  examples)  and  when  four  basis 
functions  are  included*  The  latter  is  recommended  as  the  more 
reliable  proceaure,  and  is  adopted  for  the  operator  tested  here. 
For  a  cx6  window,  Hummel's  horizontal  mask  would  be: 
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2.2.  Regional  operators 

2.2.1.  General  comments 

Regional  operators  are  computationally  sensible  only  if  they 
can  De  applied  at  many  fewer  points  than  their  local  competitors. 
Hueckel  originally  proposed  a  sequential  scheme  for  application 
of  such  templates,  out  they  are  perfectly  suitable  to  parallel 
application  on  a  regular  pattern  of  overlapping  regions,  with 
some  means  of  selection  of  'the'  edge  among  the  several  that 
might  be  rerortea  on  a  given  subregion  (for  this  study,  the 
maximum  response  at  each  point  in  the  region  was  selected).  A 
convenient  pattern  i  s  to  apply  the  operators  on  2Nx2N  regions, 
overlapping  by  N  points  on  every  side.  The  final  result  is  then 
a  lattice  o 4  outputs,  each  representing  an  NxN  cell,  for  each  of 
which  a  w e l l -d et er m ined  edge,  orientation,  and  position  within 
the  cell  are  given.  Because  of  this  data  compression,  it  is 
probably  most  accurate  to  consider  the  output  from  regional 
operators  as  being  comparable  to  thinned  or  similarly  processed 
outDut  froh  local  operators,  rather  than  to  the  raw  local  edge 
out  put  . 
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While  regional  operators  automatically  produce  thin  edges, 
anu  have  sore  advantages  over  local  operators  simply  because  more 
of  the  image  tan  be  seen  at  one  time,  the  large  domains  bring 
with  them  some  disadvantages  as  well.  The  need  to  find  only  one 

edge  in  a  region  means  that  one  may  expect  such  operators  to  fail 

if  'clutter'  (closely  adjacent  edges)  or  substantial  textural 
variation  is  expected  within  a  single  region.  Difficulty  may 

also  arise  in  distinguishing  ramps  from  edges  (a  ramp  will 

produce  larr. e  gray  level  differences  at  extreme  points  of  a  large 
winnow,  even  if  it  is  only  just  noticeable  on  a  small  one). 
Finally,  the  operator  may  not  respond  to  'real'  edges  which  do 
not  tratch  the  'ioeal'  type  assumed. 

c.o.o.  Hueckel's  operator 

Haeckel  ( Re t  o)  introduced  a  novel  edge-detection  algorithm, 
»nich  has  prompted  a  number  of  recent  commentaries  (e.g.  Ref  9). 
The  algorithm  can  best  be  describes  by  a  summary  listing  of  its 
c  n  u  r  ac  t  e  r  i  s  ti  c  features. 

First:  The  choice  of  'ideal  edge'  is  unusual.  In  fact,  for 
both  theoretical  and  practical  reasons,  what  is  defineo  is  an 
ioeal  ecge-line.  Two  parallel  lines  divide  a  continuous 
oiak-shaped  domain  into  three  regions.  A  template  on  which  each 
of  these  regions  has  a  constant  gray-level  is  called  an 
eo. e-line.  To  identify  an  edge  with  such  a  template,  the  edge  is 
defineo  to  be  parallel  to  the  given  lines  and  to  lie  within  the 
center  regi  .n,  wei^htea  to  lie  nearer  the  greater  gray-level 
uiiccntinui ty.  The  height  of  the  edge  is  the  difference  between 
the  ar«y-le  vel s  of  the  two  outer  regions;  the  breadth  of  the  edge 
is  taken  to  ce  the  width  of  the  center  region.  (An  earlier  paper 
Zkef  6lJ  useo  a  more  conventional  edge  definition.) 

Second:  Thi*  class  of  edge-mocels  is  specifiable  with  six 
parameters.  A  basis  of  functions  over  the  disk  is  specified.  It 
will  not  generally  be  possible  to  match  more  than  six  expansion 
coefficients  of  an  arbitrary  image  on  the  region  with  the 
corresponding  coefficients  for  any  ideal  edge-line.  One  can, 
therefore,  speak  of  the  best  eoge  as  the  edge  associated  with  an 
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edge-line  which  matches  some  set  of  expansion  coefficients  of  an 
image  most  nearly. 

Third.  Hueckel  stated  that  by  restricting  a  particular  expansion 
to  nine  terms,  an  analytic  solution  to  the  optimization  was 
possiole,  while  sufficient  'extra  freedom'  was  present  to  allow 
the  mismatch  between  a  best  edge  and  the  given  function  to  act  as 
a  measure  of  adequacy  of  the  edge  description.  Hueckel's  final 
algorithm,  then,  consists  of  the  following  steps: 

a)  Cover  the  region  to  be  examined  by  overlapping 
approximately  disk-shaped  windows,  within  each  of  which  the 
Lest  edge  is  to  be  found. 

c)  In  each  window,  evaluate  the  overlap  of  the  observed 
function  with  nine  p r e d e t e r m in e d  basis  functions, 
c)  Pe  rform  a  calculation  to  determine  the  edge-line  which 
cest  fits  the  aata. 

u )  If  the  fit  is  sufficiently  good,  the  height  of  the  edge 
sufficient,  and  the  breadth  not  too  great,  an  edge  is 
reported  with  the  calculated  parameters. 

This  innovative  approach  to  edge  detection  suggests  a  numoer 
of  possitle  mo ai f i c a t  i  o n s  which  might  make  it  computationally 
less  expensive.  However,  Hueckel's  basic  approach  to 
optimisation  suffers  from  an  error  that  would  appear  to  hamper 
any  oevious  mouification  of  the  method  (noted  as  Appendix  A). 
The  practical  e f T t c t  of  this  difficulty  is  largely  to  make  the 
parameters  ootoinea  for  borderline  fits  extremely  erratic. 
Occasionally,  however,  apparently  reliable  fits  are  similarly 
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A  regional  operator  on  a  discrete  domain 


3.1.  Assumptions  of  the  algorithm 

Hueckel's  algorithm  is  an  attempt  to  find  an  optimal  fit  of 
a  reasonably  adequate  edge  model  for  a  region  of  moderate  size* 
at  moderate  co  ir.Dut  a  ti  ona  l  cost*  To  achieve  that  goalt  a 
continuous  class  of  edge-models  was  chosen  so  that  the  usual 
analytic  procedures  for  ext remi zat ion  of  a  function  could  be 
applied.  *-gain,  for  simplicity  of  this  kind*  the  domain  chosen 
fcr  anolysis  was  a  disk,  and  the  procedures  used  were  strictly 
appropriate  only  for  a  perfectly  resolved  (not  discrete)  image. 
The  algorithm  resulting,  however,  is  theoretically  inadequate 
(Appencix  A  ),  ana  might  be  expected  to  be  rather  less  reliable  on 
textured  images  than  on  simpler  scenes.  It  is  not  obvious  that 
any  simple  modification  of  Hueckel's  procedure  will  remove  either 
inadequacy,  yet  regional  edge  extraction  seems  a  worthwhile  idea, 
at  least  for  comparison  with  local  methods.  The  edge  model 
descricec  :elow  differs  from  Hueckel's  in  almost  every  possible 

way  -  except  that  both  are  regional  operators.  (This 

similarity  of  type  in  many  ways  outweighs  the  differences  in 
detail;  in  actual  use,  they  are  more  alike  than  Hueckel's  and 
Hummel's  operators,  despite  the  similarities  in  the  underlying 
theory  of  the  latter  two.) 

If  analyticity  seems  unattainable,  there  is  little  advantage 
in  using  a  circular  domain  of  definition  for  the  edge  model,  and 
definite  practical  disadvantages,  as  disks  overlap  rather  poorly 
comoared  to  rectangles.  Further,  for  domains  of  the  order  of  10 
pixels  by  13,  the  graininess  of  a  real  digitized  image  need  not 
be  negligible,  so  an  intrinsically  discrete  model  seems 
appropriate  • 

What  is  an  edge  to  be,  then?  Suppose  we  examine  a  small, 
rectan„ular  i  ma  ae  of  a  window.  For  each  separate  row,  we  can 
surely  find  a  best  left/right  division  into  a  bright  side  and  a 
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dark  side,  with  the  dividing  line  allowed  to  fall  between  any 
pair  of  adjacent  pixels.  If  the  window  over lies  a  true  edge,  we 
uojIc  expect  all  the  divisions  to  be  consistent  in  their  sense, 
and  to  well  represent  the  image  in  each  separate  row.  Moreover, 
we  would  expect  the  division  point  to  vary  in  a  smooth  way  from 
row  to  row.  If  no  edge  exists,  any  'clear'  edges  from  single 
rows  should  be  contradicted  by  nonexistent  or  opposing  edges  from 
nea  r oy  rows  . 

An  edge  will  therefore  be  called  (in  this  section)  'perfect' 
if  in  each  row  (.nc  column)  it  is  a  perfect  one-dimensional  edge, 
and  further,  the  division  point  is  strictly  monotone  as  one  moves 
from  t ne  top  of  the  window  to  the  bottom  Cor  from  left  to  right). 
The  latter  restriction  is  required  for  the  definition  to  be 
symmetric  for  rows  and  for  cotumns;  it  includes  all  straight 
euges  and  many  well-behaved  curved  ones,  and  excludes  jumbled 
'cults'  that  one  would  not  normally  wish  to  call  perfect.  The 
resultcnt  edge  templates  consist  entirely  of  ♦/- 1*  forming  two 
uniform  connected  regions  divided  by  a  monotone  boundary.  The 
cor  respond  ng  'perfect'  edge  would  be  a  scalar  multiple  of  such  a 
template,  plus  a  constant  offset. 

An  algorithm  for  obtaining  the  template  of  this  type  having 
maximum  overlap  with  a  given  input  is  given  as  Appendix  B.  The 
mini  n>u  m  mea  n-s  qu  .re-  e  rr  o  r  of  fit  between  a  given  window  and  an 
ed.,3  template  of  this  class  would  provide  the  most  rigorous 
criterion  for  the  best  match.  As  this  criterion  is  not 
dec omposacl r  li.e.  a  perfect  fit  over  part  of  the  window  need 
not  te  part  of  the  perfect  fit  over  the  full  window),  it  appears 
to  require  :  full  aynamic  programming  or  other  state-space  search 
to  assure  optimality.  This  seems  computationally  inappropriate; 
therefore  the  maximum  sum  criterion,  which  is  decomposable,  was 
selected  as  the  more  useful.  The  given  algorithm  finds,  rather 
quickly,  a  reasonably  good  edge  exemplar  for  any  window. 
Op t i mi  1a t io n  of  this  quantity  will,  in  many  cases,  also  optimize 
the  better  criterion. 
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3.4.  Description  of  the  algorithm 

The  point  of  the  algorithm  is  very  simple.  Since  the 
adequacy  criterion  being  applied  is  decomposable*  the  idea  is 
simply  to  find  the  best  template  for  the  bottom  k  rows*  then 
extend  that  result  to  the  bottom  k+1  rows*  iterating  until  the 
full  template  has  been  defined. 

Let  the  input  picture  be  represented  as  I(i,j).  pirst,  it 
is  transformed  to  have  zero  mean.  An  intermediate  matrix  is  then 
g i ve n  Ly  : 

A(i,j)-  Ik-o  I(V»k)  *  Ik=j+iIM’k) 

(on  an  NxN  domain) 

Tne  remaining  transform  is  then: 

3  ( 1  *  j  )  =  A  ( 1  f  j  ) 

3(i,j)  =  A(i,j)  +  max<B(i-1,k);  i>1»  k  <  j> 

Each  cell  of  A  gives  a  'score'  for  a  one -d i mens i ona l  edge 
template  for  its  row,  with  the  pos  it  i  ve /negat  i  ve  boundary  locateo 
between  the  cell  and  its  right  neighbor.  Each  cell  of  B  then 
gives  the  score  of  a  partial  template*  monotone  as  required  of  an 
ideal  edge,  but  including  only  the  giver  cell  and  the  rows  below 
it.  The  ed  ae  description  is  extracted  from  B  by  beginning  at  the 
last  row,  and  selecting  the  element  with  the  largest  score. 
After  an  element  is  selected  from  row  j,  the  element  of  row  j -1 
is  selectee'  which  has  the  largest  score  of  any  cell  whose  column 
numoer  is  not  greater  than  this  cell's.  The  edge  selected  passes 
to  the  right  of  each  of  the  cells  thus  chosen.  The  basic 
algorithm  is  repeated  four  times  (for  vertical  and  horizontal 
eoges,  with  left  and  right  slants)  with  minor  modification.  The 
ed3e  with  the  highest  score  of  the  four  candidates  is  the  edge 
reported  by  the  algorithm. 

Though  the  uescription  above  may  appear  somewhat  awkward* 
the  algorithm  executes  rather  faster  than  Hueckel's  algorithm, 
ana  cannot  exhiuit  pathological  behavior  as  the  latter  may 
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4.  Experimental  comparisons 


4.1.  Method 

The  ex  erimental  study  included  two  kinds  of  comparisons  of 
the  adequacy  of  the  operators.  The  first  group  of  measurements 
were  all  of  a  type.  In  each  case*  a  given  operator  was  applied 
to  the  'perfect"  version  of  a  picture  (those  used  are  shown  as 
Fig.  1a,b,c).  The  operator  was  also  applied  to  'distorted' 

versions  uf  tne  same  picture.  Sind  the  signal/noise  ratio 

measured,  with  the  original  edge  output  defining  the  signal 

strength,  end  with  the  difference  attributable  to  the  distortion 

interpreted  a  s  noise.  The  distortions  examined  were 
(approximately  Poisson)  w  ide- spect  rum  .  uncorrelated  noise,  edge 
blurring,  and  imposition  of  an  overall  linear  ramp  on  the  entire 
picture.  All  of  these  are  common  imperfections,  and  all 
interfere  to  some  extent  with  edge  extraction. 

The  intent  of  making  the  measurements  in  this  way  is  to 
provide  a  measure  of  consistency  which  can  be  applied  to  all  of 
the  operators  tested,  despite  substantial  differences  in  the  type 
of  eoge  picture  produced.  Unfortunately,  some  mental  rescaling 
of  results  remains  necessary,  as  the  broad  response  of  a  local 
operator  invariably  overlaps  better  with  its  perturbed  version 
than  do  the  narrow  edge  images  produced  by  the  regional 
operators.  The  experimental  results  are  shown  as  Table  1. 

In  addition  to  these  stability  measurements,  the  simple 
nature  of  the  polygonal  images  allowed  a  comparison  of  ideal 
values  of  edge  parameters  with  the  extracted  values  for  the 
undistorted  images,  as  well  as  for  a  single  'distorted'  version, 
blurreo  over  aojucent  points  then  combined  with  Poisson  noise  (as 
in  the  earlier  test)  giving  a  s ignal -to -noi se  ratio  of  about  2:1. 
The  results  of  these  measurements  are  given  as  Table  2. 


(a) 


(b) 


(c) 


Figure  1.  Test  images. 

a,b:  Synthetic  polygonal  images. 

(Edges  are  inclined  at 
integer  multiples  of  5° 
from  horizontal.) 

c  ('girl'):  Real  image  for 
reliability  study. 
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4.2.  Results  ana  Discussion 

4.2.1.  Loc  3 1  operators 

4. 2. 1.1.  3  ene  ra  l 

All  of  the  local  operators  tested  were  able  to  detect 
distorted  edge  directions  on  small  (6x6)  domains  to  an  accuracy 
of  about  13  degrees.  Edge  magnitude  was  normally  accurate  within 
ucout  ten  percent.  On  larger  (9x9)  regions*  angular  resolution 
wus  improved  (chouah  at  substantial  computational  cost)  but  ramps 
tegan  to  oecome  a  significant  source  of  spurious  response. 
Accuracy  measurements  were  included  on  12x12  domains  for 
comparison  witn  regional  methods*  though  local  operators  are  very 
costly  on  such  large  domains. 

4.w.1.c.  Tha  Sooel  and  Mero-Vassy  operators 

Though  these  operators  are  of  comparable  accuracy  when 
applieu  cn  regions  of  the  same  size,  Sob e  l 's  operator  seems 
uniformly  superior,  ana  not  much  higher  in  cost  than  the  simpler 
Mero-Vassy  operator.  Some  of  the  difference  is  systematic,  and 
coulc  be  jiminisnec  by  use  of  a  slightly  modified  angle 
Calculation  in  the  "ero-Vassy  case,  but  on  typically  noisy  images 
t  n i s  effect  wo^lu  likely  be  negligible  compared  to  the  local 
irregularities. 

4. 2. 1.o.  Hummel's  operator 

This  operator  is  computationally  more  expensive  to  apply 
tnan  the  other  local  operators  ana,  on  very  small  domains,  not 
very  different  in  response.  On  larger  regions  (9x9)  it  is  better 
aole  to  reject  lo.-f  requency  imperfections,  such  as  ramps  anc 
off-center  cages. 

4.2.4.  Regional  Operators 

The  two  operators  performed  similarly  in  these  tests. 
3escitfc  th  ••  theoretical  shortcomings  noted,  Hueckel's  operator 
was  accurate  tc  within  a  few  degrees  in  the  presence  of  mila 
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noise  or  blurring,  while  edge  height  was  similarly  accurate.  The 
discrete  edge  operator,  as  it  does  not  report  an  angle  directly, 
was  compared  by  matching  the  actual  edge  points  reportea  within 
the  images  examined*  No  substantial  differences  were  found  on 
relatively  undistorted  windows*  The  discrete  operator,  however, 
was  less  affected  by  the  presence  of  imperfections.  Eoth 
operators  produce  go  odne  s  s-of-f  i  t  measures  that  can  be  used  to 
cause  a  'no  eu:,e'  response  if  the  edge  fit  doesn't  meet  some 
criterion.  For  »_oth  ,  these  bounds  were  made  as  permissive  as 
possible,  as  for  use  with  higher-level  processing  'best  guess' 
edges  are  o'*  far  more  use  than  simply  'not-edge'.  In  a  few 
cases,  these  lax  criteria  allowed  ridiculously  bad  parameter 
estimates  to  be  output  by  the  Hueckel  operator.  Where  this 
occcured,  these  responses  were  not  included  in  the  accuracy 
estimates,  tut  tne  resulting  measure  is  marked  by  an  asterisk. 

4.L.3.  General  remarks 

In  comparing  operators  for  use  with  higher-level  picture 
processing  systems,  it  is  clear  that,  for  better  or  worse, 
regional  operators  are  best  thought  of  as  already  processing 
their  output  somewhat,  compared  to  local  operators.  As  a  result, 
regional  operators  provide  their  information  in  a  rather  more 
compact  form,  anu  may  well  be  preferred  for  that  reason  for  the 
relatively  expensive  processing  of  later  stages. 

Tne  specific  comparisons  revealed  nothing  surprising. 
Accuracy  in  angular  information,  in  the  presence  of  slight 
aistortion,  was  largely  a  function  of  the  area  of  application, 
not  of  the  operator  selected.  All  operators  were  comparably  able 
to  find  the  size  of  the  edge  in  their  domain.  A  particular 
feature  of  the  Hummel,  Hueckel,  and  discrete  regional  operators 
is  that  all  report  some  sort  of  goodness-of-f i t  measure  as  a 
result  of  t  *-e  fitting  process  itself.  For  the  other  operators, 
accurate  extraction  of  such  a  quantity  would  be  more  expensive 
than  actual  application  of  the  edge  operator. 
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5.  Appendices 


A:  Hueckel's  edge/line  algorithm 


In  Hueckel's  1973  description  of  an  edge/line  detection 
algorithm  (Ref  o)  ,  as  in  an  earlier,  similar  paper  (Ref  6b),  great 
stress  is  placed  on  the  theoretical  basis  for  the  algorithm  oeing 
introduced.  A  major  point  of  this  algorithm  is  that  determination  of 
the  optimum  values  of  the  edge-line  parameters  can  be  carried  out 
analytically,  reoucing  by  elementary  means  to  the  solution  of  a 
quart  ic  equation  in  a  single  variable,  plus  a  few  simple  ancillary 
eauat  ions*  Independent  of  the  effectiveness  of  the  algorithm  in 
practice,  it  is  important  to  realize  that  the  analytic  method 
descriceu  need  not,  in  fact,  give  optimum  parameter  values,  and  that 
the  'proof'  of  its  adequacy  was  incorrect  in  an  essential  way.' 

A  brief  outline  of  the  attempted  proof  is  sufficient  to  make  the 
difficulty  clear.  Given  expressions  for  the  nine  basis  coefficients 
for  an  ideal  eoge-line  described  by  the  parameters  ©  and 
(x1,...,x5)  =  'tuple',  it  is  required  to  find  values  for  0  ,  tuple 
which  minimize  the  expression 

N  =  (a(i)  -  s(i:  ©  ,  tuple)  )  , 

where  the  a(i)  are  measured  coefficients,  and  the  s(i)  are  'ideal' 
values.  The  approach  taken  was  to  notice  that  the  above  expression 
coulu  oe  rewritten  as  ( 

N  =  a ( i )  +  f1(©  ,  tuple)  +  f  2 (  6  ). 

In  this  expression,  the  first  term,  being  independent  of  the 
parameters,  does  not  affect  the  m  i  ni  mi  za  t  i  on .  For  each  ©  ,  the 

equation  f 1 (  ©  ,  tuple)  =  0  was  shown  to  be  analytically  solvable. 
Thus,  minimization  of  N  was  stated  to  amount  simply  to  minimization 
of  f£  as  a  function  of  theta,  followed  by  evaluating  the  best  'tuple' 
values  for  that  optimum  theta  value. 

The  aoove  proceaure  would,  in  fact,  minimize  N  iff  fl  could  be 
shown  to  be  nonne  „e  ti  ve.  For  real  parameter  values,  this  is  in  fact 
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the  case.  Unfortunately,  solution  of  fl  =0  requires,  in  general, 
complex  values  for  some  parameters.  When  complex  parameter  values 
are  allowed,  fl  is  no  longer  non-negat i ve  ,  and  zero  need  not  be  an 
extreme  value.  Therefore,  whenever  complex  parameters  are  obtained 
oy  rtueckel's  algorithm,  it  has  failed  to  determine  the  optimum 
parameter  values  for  the  edge.  (The  explicit  algorithm  included  in 
^ef  4  always  selects  the  real  parts  of  complex  parameters  as  the 
optimize^  values  actually  reported.  This  aspect  of  the  algorithm  is 
nowhere  cescribeo  or  justified  in  the  text,  and  does  not  repair  the 
inaccuracy  notea.)  Moreover,  assuming  the  optimum  fl  contribution 
always  to  be  zero,  when  it  sometimes  is  not,  causes  the  algorithm  to 
mike  excessively  optimistic  estimates  of  the  reliability  of  such 
nisassignment  ;• 

i  related  difficulty,  rarely  encountered,  is  that  while  the 
entire  uomai n  visible  to  the  operator  is  described  by  an  ' r' 
parameter  between  b  ana  1,  it  is  perfectly  possible  for  the  algorithm 
to  report  an  edge  at  r=2,  for  instance,  completely  outside  the 
observed  region.  There  is  no  reason  why  such  an  'edge''  should  not  be 
founo  to  be  highl,  reliable.  Both  these  sorts  of  eccentric  behavior 
are  rare,  and  can  ce  explicitly  watched  for  by  the  algorithm,  which 
coulj  then  assume  tnat  no  edge,  in  fact,  was  present.  They  are, 
however,  outs  ide  the  framework  of  the  discussion  of  the  method 
provided  oy  ^uecktl.  This  sort  of  difficulty  seems  to  appear  in  any 
small  modification  of  the  method  intended  to  retain  the  general 
structure  while  decreasing  the  computational  load,  or  while  usin3  a 
oe  1 1  e  r  -peh  a  ve  r ,  rectangular  domain.  It  is  largely  for  this  reason 
that  the  regional  operator  introduced  in  this  paper  takes  such  a 
different  torn  from  Hueckel's. 
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a:  A  discrete,  regional  edge  detection  algorithm 

procedure  edg  e(i  nput  , succeed, template); 
integer  array  input,  template; 
boolean  succeed; 

<<params  criterion  =  minimum  total  edge  response  in  the 

region  consistent  with  the  existence 
of  an  edge,  >> 

ce  g  i  n 

integer  array  NO  k*  ALII  :  si  z e  ,  1  :  s i  z e3  »  At  1 : s  i ze  , 0 :  s  i  ze 3  , 

" Cl  :si2e,0:size,1  :  43  ; 

s  <  *  *  •*  normalize  input  *  *  *  >> 

fori  _ncrii.alizcd_input(INPUT,  NORMAL); 

<<  ►■>  summing  over  the  region  to  get  the  mean  value, 
then  subtracting  throughout  >> 

Sj'j.r  a  urn _of _s guar e s ( NORM AL  )  ; 

succeec  =  'false'; 

if(SU“SiR  Iss  criterion)  then  return 
else 

<<  ***  form  input  transforms  ***>> 

oe  3  i  n 

for  JP:=  0  step  1  until  size  do 
for  K:=1  steo  1  until  4  do 
oCI  ,J  P,Kj  :=  A  Cl,  JPD; 
for  I:=  2  step  1  until  size  do 
->  t  g  i  n 

t.Cl,JD,1J  :=  A  Cl,  JP3*maxCE>Cl-1  ,K,  1]  :  K  le  JP>; 

~CI,J'-,2J  :=  A  Cl, JP3+minCBCl-1 ,K, 3D  :  K  le  JP>; 

u C  I ,  J  f' , 3  ]  :=  A  Cl, JP3  +  maxl6Cl-1 ,K,33  :  K  ge  JP>; 

u  C  I ,  J  P  ,  4  3  :=  A  Cl, jP3  +  m1n<6Cl-1 ,K, 43  :  K  ge  JP>; 
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o<  ***  th  n  extract  the  optimum  edge  template  ***  >> 

procedure  t  st  ( i  no  1 ,  i  nd 2, sign, positionfvalue, which); 
integer  ind1»  i nd 2 ,  which; 
integer  array  position 
real  s  i  g  r; 
real  a  rr  -  y  v  a  iue; 
c  e  j  i  n 

if  . Z i nd 1 , inc2 » wh i c h 3  >  s i gn *v a lu e Cw h  i  c  h 3  then 
oe  u  i  n 

va  l  ue  2w  ni  ch  3  :=  B  C i nd 1  , i ndt  » wh ich 3 ; 
p  o  itior.L«hich3  :=  i  n  u  2  ; 
en  c ; 

for  <:~1  at  tv  1  until  4  do  edgeLK3  :=  bCN,0»K3; 
for  J':=1  itco  1  until  N  go 

ie-in 

t  e  r  t  (  N »  «  F  ,  1  .,pos,edge,1); 
tj  - t(,<,  j?,-1.tpos,?age,2); 
test(fj*jP»1  .»pos,ed3et3); 
test(NtjP»-1.*pos,eoge,4); 
c-no; 

Pest  :=  relect_;nax(edgeCK3»  K:  =  1  to  4); 

<<  set  'i.e  st'  ta  inoex  of  template  with  maximum  score  >> 

for  I  :  ='!  -1  step  -1  jntil  1  oo 
tor  Jr:  =  o  step  1  until  N  oo 
i-e  g  i  n 


if  t  es  t=  1 

an  c 

jp 

l  e 

e  dg  e  C 1 3 

then 

test  ( I 

» J  P » 

1 . , p  os , edge ,  1  )  ; 

if  res  t  =  i. 

ana 

j  p 

l  e 

ed3  eC23 

then 

t  e  st  ( I 

*  J  P » 

-1 . , pos ,edge  » 2  ); 

if  est=. 

and 

j  p 

ge 

ed  g  e  L 3  3 

then 

test  (I 

,JP, 

1 . , pos , edge , 3  )  ; 

if  -  e s  t=  ** 

an  c 

j  p 

ge 

edaeC43 

then 

te  st  ( I 

iJp* 

-1 . t  pos ,edge  ,4); 

t  omK  l  c.  te  '  J  P  j  :=•  ecgerbest3; 
eno  ; 
o-no; 
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